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Abstract 

A class of analog computers built from large numbers 
of microscopic probabilistic machines is discussed. It 
is postulated that such computers are implemented in 
biological systems as ensembles of protein molecules. 
The formalism is based on an abstract computa- 
tional model referred to as Protein Molecule Ma- 
chine (PMM). A PMM is a continuous-time first- 
order Markov system with real input and output vec- 
tors, a finite set of discrete states, and the input- 
dependent conditional probability densities of state 
transitions. The output of a PMM is a function of 
its input and state. The components of input vec- 
tor, called generalized potentials, can be interpreted 
as membrane potential, and concentrations of neu- 
rotransmitters. The components of output vector, 
called generalized currents, can represent ion cur- 
rents, and the flows of second messengers. An En- 
semble of PMMs (EPMM) is a set of independent 
identical PMMs with the same input vector, and the 
output vector equal to the sum of output vectors of 
individual PMMs. The paper suggests that biologi- 
cal neurons have much more sophisticated computa- 
tional resources than the presently popular models of 
artificial neurons. 



1 Introduction 

After the classical work of Hodgkin and Huxley , it 
is widely recognized that the conformational changes 
in the sodium and potassium channels account for the 
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generation of nerve spike. In this specific case, the 
time constants of the corresponding temporal pro- 
cesses are rather small (on the order of a few mil- 
liseconds). It is known that in some other cases 
(such as the ligand-gated channels) the time con- 
stants associated with conformational changes in pro- 
tein molecules can have much larger values [S] |S] . 
The growing body of evidence suggests that such 
slower conformational changes have direct behavioral 
implications |3IH|E1- That is, the dynamical compu- 
tations performed by ensembles of protein molecules 
at the level of individual cells play important role in 
complex neuro-computing processes. 

An attempt to formally connect some effects of 
cellular dynamics with statistical dynamics of con- 
formations of membrane proteins was made in jl]. 
The present paper discusses a generalization of this 
formalism. The approach is based on an abstract 
computational model referred to as Protein Molecule 
Machine (PMM). The name expresses the hypothesis 
that such microscopic machines are implemented in 
biological neural networks as protein molecules. A 
PMM is a continuous-time first-order Markov system 
with real input and output vectors, a finite set of 
discrete states, and the input-dependent conditional 
probability densities of state transitions. The output 
of a PMM is a function of its input and state. 

The components of input vector, called generalized 
potentials, can be interpreted as membrane potential, 
and concentrations of neurotransmitters. The com- 
ponents of output vector, called generalized currents, 
can be viewed as ion currents, and the flows of second 
messengers. 

An Ensemble of PMMs (EPMM) is a set of inde- 
pendent identical PMMs with the same input vec- 
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tor, and the output vector equal to the sum of out- 
put vectors of individual PMMs. The paper explains 
how interacting EPMMs can work as robust statisti- 
cal analog computers performing a variety of complex 
computations at the level of a single cell. 

The EPMM formalism suggests that much more 
computational resources are available at the level 
of a single neuron than is postulated in traditional 
computational theories of neural networks. It was 
previously shown [3 ISJ that such cellular computa- 
tional resources are needed for the implementation of 
context-sensitive associative memories (CSAM) ca- 
pable of producing various effects of working memory 
and temporal context. 

A computer program employing the discussed for- 
malism was developed. The program, called CHAN- 
NELS, allows the user to simulate the dynamics of 
a cell with up to ten different voltage-gated chan- 
nels, each channel having up to eighteen states. Two 
simulation modes are supported: the Monte-Carlo 
mode (for the number of molecules from 1 to 10000), 
and the continuous mode (for the infinite number of 
molecules). New program capable of handling more 
complex types of PMMs is under development. (Visit 
the web site www.brainO.com for more information.) 

The rest of the paper consists of the following sec- 
tions: 

2. Abstract Model of Protein Molecule Machine 
(PMM) 

3. Example: Voltage-Gated Ion Channel as a PMM 

4. Abstract Model of Ensemble of Protein Molecule 
Machines (EPMM) 

5. EPMM as a Robust Analog Computer 

6. Replacing Connections with Probabilities 

7. Examples of Computer Simulation 

8. EPMM as a Distributed State Machine (DSM) 

9. Why Does the Brain Need Statistical Molecular 
Computations? 

10. Summary 



2 Abstract Model of Protein 
Molecule Machine (PMM) 

A Protein Molecule Machine (PMM) is an ab- 
stract probabilistic computing system (X, Y, S, a, w), 
where 

• X and Y are the sets of real input and output 
vectors, respectively 

• S= {so, ..s„_i} is a finite set of states 

• a:XxSxS— >R'isa function describing 
the input-dependent conditional probability den- 
sities of state transitions, where a{x, Si, Sj)dt is 
the conditional probability of transfer from state 
Sj to state Si during time interval dt, where 
a; G X is the value of input, and R' is the set 
of non-negative real numbers. The components 
of X are called generalized potentials. They can 
be interpreted as membrane potential, and con- 
centrations of different neurotransmitters. 

• a;:XxS^Yisa function describing output. 
The components of y are called generalized cur- 
rents. They can be interpreted as ion currents, 
and the flows of second messengers. 

Let a; e X, y e Y, s e S be, respectively, the values 
of input, output, and state at time t, and let Pi be 
the probability that s = Si. The work of a PMM is 
described as follows: 

ji-i 

att^O ^ = 1 (2) 

i=0 

y^uj{x,s) (3) 

Summing the right and the left parts of ^ over 
i — 0, ..n — 1 yields 

d(y"-^ PA 
^^'7° " = (4 
dt ^ ' 

so the condition Q holds for any t. 
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dp//=a{x,S;,s,-)P,dt 
/ Output 
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Current state 

s=S; dpy-= a{x,s,-,spP^- dt 



Figure 1 : Internal structure of PMM 

The internal structure of a PMM is shown in Fig- 
ure 1, where dpij is the probability of transition from 
state Sj to state Si during time interval dt. The gray 
circle indicates the current state s = Si. The output 
y = uj{x,s) is a function of input and the current 
state. 

For the probability of transition from state Sj to state 
Si we have 



dpij = a(x, Si, Sj)Pjdt 
It follows from ^ that 

dPt = ^ {dpij - dpji) 



(5) 
(6) 



3 Example: Voltage-Gated Ion 
Channel as a PMM 

Ion channels are studied by many different disci- 
plines: biophysics, protein chemistry, molecular ge- 
netics, cell biology and others (see extensive bibli- 
ography in 0). This paper is concerned with the 
information processing (computational) possibilities 
of ion channels. 

I postulate that, at the information processing 
level, ion channels (as well as some other membrane 
proteins) can be treated as PMMs. That is, at this 
level, the exact biophysical and biochemical mecha- 
nisms are not important. What is important are the 
properties of ion channels as abstract machines. 

This situation can be meaningfully compared with 
the general relationship between statistical physics 



and thermodynamics. Only some properties of 
molecules of a gas (e.g., the number of degrees of free- 
dom) are important at the level of thermodynamics. 
Similarly, only some properties of protein molecules 
are important at the level of statistical computations 
implemented by the ensembles of such molecules. 

The general structure of a voltage-gated ion chan- 
nel is shown schematically in Figure |21t. Figures |2t> 
and|2t show how this channel can be represented as 
a PMM. In this example the PMM has five states 
s G {0, 1, ..4}, a single input x = V (the membrane 
potential) and a single output y — I (the ion cur- 
rent). Using the Goldman-Hodgkin-Katz (GHK) cur- 
rent equation we have the following expression for the 
output function uj{x, s). 



PjZ^FV'iC"" - C° 



-zV' 



-zV 



(7) 



where 

• Ij is the ion current in state s — j with input 

x = V 

• pj [cm/ sec] is the permeability of the channel in 
state s — j 

• 2 is the valence of the ion (z = 1 for and 

Na+, z = 2 for Ca++) 
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Figure 2: Ion channel as a PMM 
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• F = 9.6484-10'* [C/mol] is the Faraday constant 

» V' — is the ratio of membrane potential to 
the thermodynamic potential, where T [K] is the 
absolute temperature, R = 8.3144 [J/K ■ mol] 
is the gas constant 

• C™ and (7°"* [mol] are the cytoplasmic and ex- 
tracellular concentrations of the ion, respectively 

One can make different assumptions about the func- 
tion a(x, Sj , Si), describing the conditional probabil- 
ity densities of state transitions. It is convenient to 
represent this function as a matrix of voltage depen- 
dent coefficients aij{V). 



a^QiV) 

Clmj 



aojiV) 



iV) . 

(V) 



aom{V) \ 
aim{V) 



(8) 



where m — Note that the diagonal elements of 

this matrix are not used in equation 

In the model of spike generation discussed in ^ 
both sodium, Na^, and potassium, channels 
were treated as PMMs with five states shown in Fig- 
ure El Coefficients oio, a2i, 032 where assumed to 
be sigmoid functions of membrane potential, and co- 
efficients 043 and ao4 - constant. In the case of the 
sodium channel, s = 3 was used as a high permeabil- 
ity state, and s = 4 was used as inactive state. In 
the case of potassium channel, s — i and s = 4 were 
assumed to be high permeability states. 

Note. As the experiments with the program CHAN- 
NELS (mentioned in Section^) show, in a model with 
two voltage-gated channels [K'^ and A^a+), the spike 
can be generated with many different assumptions 
about functions a and lj. 



4 Abstract Model of Ensem- 
ble of Protein Molecule Ma- 
chines (EPMM) 

An Ensemble of Protein Molecule Machines (EPMM) 
is a set of identical independent PMMs with the same 



input vector, and the output vector equal to the sum 
of output vectors of individual PMMs. 

The structure of an EPMM is shown in Figure |31 
where N is the total number of PMMs, is the 
output vector of the k-th PMM, and y is the output 
vector of the EPMM. We have 



N 
k=l 



(9) 



Let Ni denote the number of PMMs in state s = i 
(the occupation number of state i). Instead of © we 
can write 

n-l 

y = ^iV,w(x,s,) (10) 

i=0 

Ni (i = 0, ...n — 1) are random variables with the 
binomial probability distributions 



P{N, = m} = ( ^ 1 P™(1 - P,)^-'" (11) 



Ni has the mean fii = NPi and the variance 
NP,{l-P,). 

Let us define the relative number of PMMs in state 
s = i (the relative occupation number of state i) as 



N 



(12) 
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Figure 3: The structure of EPMM 
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The behavior of the average is described by the 
equations similar to and 

^ = ^o:{x,s,,Sj)ej -^e,^a{x,s■i,s^) (13) 



dt 

3+1' 

att^O 



(14) 



1=0 



The average output y is equal to the sum of average 
outputs for all states. 



i=0 



The standard deviation for is equal to 



(15) 



(16) 



It is convenient to think of the relative occupation 
numbers as the states of analog memory of an 
EPMM. In [3 El m the states of such dynamical cel- 
lular short-term memory (STM) were called E-states. 

Figure 21 illustrates the implementation of E-states 
as relative occupation numbers of the microscopic 
states of a PMM. The number of independent E-state 
variables is equal to rt — 1. The number is reduced 
by one because of the additional equation 

5 EPMM as a Robust Analog 
Computer 

An EPMM can serve as a robust analog computer 
with the input-controlled coefficient matrix shown in 
FigureEl Since all the characteristics of the statistical 
implementation of this computer are determined by 
the properties of the underlying PMM, this statistical 
molecular implementation is very robust. 

The implementation using n integrating opera- 
tional amplifiers shown in Figure El is not very reli- 
able. The integrators based on operational amplifiers 
with negative capacitive feedback are not precise, so 
condition ((Tljl will be gradually violated. (A better 
implementation should use any n — 1 equations from 



H13|) combined with equation l|14|l .') In the case of the 
discussed statistical implementation condition (|14|l is 
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Figure 4: Relative occupation numbers of the micro- 
scopic states of a PMM as the macroscopic states of 
analog memory of the corresponding EPMM 
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Figure 5: Simulation of an EPMM using integrat- 
ing operational amplifiers with input-controlled co- 
efficient matrix 
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guaranteed because the number of PMMs, N, is con- 
stant. 



6 Replacing Connections with 
Probabilities 

The most remarkable property of the statistical im- 
plementation of the analog computer shown in Fig- 
ure [SI is that the matrix of input-dependent macro- 
scopic connections is implemented as the matrix of 
input-dependent microscopic probabilities. For a suf- 
ficiently large number of states (say, n > 10), it 
would be practically impossible to implement the cor- 
responding analog computers (with required biologi- 
cal dimensions) relying on traditional electronic oper- 
ational amplifiers with negative capacitive feedbacks 
that would have to be connected via difficult to make 
matrices of input-dependent coefficients. 

A single neuron can have many different EPMMs 
interacting via electrical messages (membrane poten- 
tial) and chemical messages (different kinds of neu- 
rotransmitters). As mentioned in Section O the 
Hodgkin-Huxley ^ model can be naturally expressed 
in terms of two EPMMs (corresponding to the sodium 



and potassium channels) interacting via common 
membrane potential (see FigureEli). Figure^D shows 
two EPMMs interacting via a second messenger. In 
this example, EPMMl is the primary transmitter re- 
ceptor and EPMM2 is the second messenger receptor. 

7 Examples of Computer Sim- 
ulation 

Figure H presents examples of computer simulation 
done by program CHANNELS mentioned in Sec- 
tion ^ Lines 2-4 in Figure [T^l display random pulses 
of sodium current produced by 1, 2, and 3 PMMs, re- 
spectively, representing sodium channel, in response 
to the pulse of membrane potential shown in line 1. 
Line 4 shows a response of 100 PMMs. (A description 
of the corresponding patch-clamp experiments can be 
found in [niE]). 

Figured) depicts the spike of membrane potential 
produced by two interacting EPMMs representing en- 
sembles of sodium and potassium channels {N oo). 

In this simulation, the sodium and potassium chan- 
nels were represented as five-state PMMs mentioned 
in Section |2| The specific values of parameters are 
not important for the purpose of this illustration. 
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Figure 6: Two EPMMs interacting via a) electrical 
and b) chemical messages 



Figure 7: Examples of computer simulation by pro- 
gram CHANNELS 
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8 EPMM as a Distributed 
State Machine (DSM) 

Let the number of PMMs go to infinity {N oo). In 
this case EPMM is a deterministic system described 
by the set of differential eauationsll3landll4l In some 
cases of highly nonlinear input-dependent coefficients 
a{x, i,j), it is convenient to think about this dynam- 
ical system as a distributed state machine (DSM). 
Such machine simultaneously occupies all its discrete 
states, with the levels of occupation described by the 
occupation vector e = (eo, ...e„_i). We replaced 
by Ci, since N — > oo. 

This interpretation offers a convenient language 
for representing dynamical processes whose outcome 
depends on the sequence of input events. In the 
same way as a traditional state machine is used as 
a logic sequencer, a DSM can be used as an analog 
sequencer. The example shown in Figure|Slillustrates 
this interesting possibility. 

If the sequence of input events is AB the DSM 
ends up "almost completely" in state 2 (lines 1-3). 
The BA sequence leads to state 4 (lines 4-6). Many 
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Figure 8: EPMM as a distributed state machine 
(DSM) 



different implementations of a DSM producing this 
sequencing effect can be found. Here is an example 
of an EPMM implementation: 

Let X = {xi,X2), s S {0,1,2,3,4}, and let a(x,i,j) 
be described as follows: if input satisfies condition 
xi > Xthri &z X2 < Xthr2 (cvcnt A) then a{x,i,j) > 
for transitions {i,j) G {(1,0), (4, 3)}; if input satisfies 
condition xi < xthri Sz X2 > xthr2 (event B) then 
a{x,i,j) > for transitions {i,j) e {(2, 1), (3, 0)}. 
In all other cases a{x, i,j) = 0. 

This example can be interpreted as follows. If in- 
put xi exceeds its threshold level Xthri before input 
X2 exceeds its threshold level Xthr2, the EPMM ends 
up "mostly" in state 2. If these events occur in the 
reverse direction, the EPMM ends up "mostly" in 
state 4. 



9 Why Does the Brain Need 
Statistical Molecular Compu- 
tations? 

Starting with the classical work of McCulloch and 
Pitts ^U] it is well known that any computable func- 
tion can be implemented as a network of rather sim- 
ple artificial neurons. Though the original concept 
of the McCuUough-Pitts logic neuron is now replaced 
by a more sophisticated model of a leaky integrate- 
and-fire (LIP) neuron the latter model is still 
very simple as compared to the EPMM formalism 
discussed in the present paper. 

Why does the brain need statistical molecular com- 
putations? Why is it not sufficient to do collective 
statistical computations at the level of neural net- 
works? The answer to this question is straightfor- 
ward. There is not enough neurons in the brain to 
implement the required computations - such as those 
associated with different effects of neuromodulation, 
working memory and temporal context 2,7 - in the 
networks built from the traditional artificial neurons. 
(Visit www.brainO.com to find a discussion of this 
critically important issue.) 
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10 Summary 

1. A class of statistical analog computers built from 
large numbers of microscopic probabilistic ma- 
chines is introduced. The class is based on 
the abstract computational model called Protein 
Molecule Machine (PMM). The discussed statis- 
tical computers are represented as Ensembles of 
PMMs (EPMMs). (Sections and H) 

2. It is postulated that at the level of neural com- 
putations some protein molecules (e.g., ion chan- 
nels) can be treated as PMMs. That is, at this 
level, specific biophysical and biochemical mech- 
anisms are important only as tools for the phys- 
ical implementation of PMMs with required ab- 
stract computational properties. (Section|31) 

3. The macroscopic states of analog memory of the 
discussed statistical computers are represented 
by the average relative occupation numbers of 
the microscopic states of PMMs. It was pro- 
posed 12 El E] that such states of cellular ana- 
log memory are responsible for the psychologi- 
cal phenomena of working memory and temporal 
context (mental set). (Section 0]) 

4. In some cases, it is useful to think of an EPMM 
as a distributed state machine (DSM) that simul- 
taneously occupies all its discrete states with dif- 
ferent levels of occupation. This approach offers 
a convenient language for representing dynami- 
cal processes whose outcome depends on the se- 
quence of input events. (Section|Sl) 

5. A computer program employing the discussed 
formalism was developed. The program, called 
CHANNELS, allows the user to simulate the dy- 
namics of a cell with up to ten different voltage- 
gated channels, each channel having up to eigh- 
teen states. Two simulation modes are sup- 
ported: the Monte-Carlo mode (for the number 
of molecules from 1 to 10000), and the continu- 
ous mode (for the infinite number of molecules). 
New software capable of handling more complex 
types of PMMs is under development. (Visit the 
web site www.brainO.com for more information.) 



Acknowledgements 

I express my gratitude to Prof. B. Widrow, Prof. L. 
Stark, Prof. Y. Ehashberg, Prof. M. Gromov, Dr. I. 
Sobel, and Dr. P. Rovner for stimulating discussions. 
I am especially thankful to my wife A. Eliashberg for 
constant support and technical help. 

References 

[1] Changeux, F. (1993). Chemical Signaling in the 
Brain. Scientific American, November, 58-62. 

[2] Eliashberg, V. (1989). Context-sensitive associa- 
tive memory: "Residual excitation" in neural 
networks as the mechanism of STM and mental 
set. Proceedings of IJCNN-89, June 18-22, 1989, 
Washington, D.C. vol. I, 67-75. Eliashberg, V. 
(1989). 

[3] Eliashberg, V. (1990). Universal learning neu- 
rocomputers. Proceeding of the Fourth Annual 
parallel processing symposium. California state 
university, Fullerton. April ^-6, 1990. 181-191. 

[4] Eliashberg, V. (1990). Molecular dynamics of 
short-term memory. Mathematical and Com- 
puter modeling in Science and Technology, vol. 
U, 295-299. 

[5] Hille, B. (2001). Ion Channels of Excitable Mem- 
branes. Sinauer Associates. Sunderland, MA 

[6] Hodgkin, A.L., Huxley, A.F. 1952. A Quantita- 
tive Description of Membrane Current and its 
Application to Conduction and Excitation in 
Nerve. Journal of Physiology, 117, 500-544. 

[7] Kandel, E.R., and Spencer, W.A. (1968). Cellu- 
lar Neurophysiological Approaches in the Study 
of Learning. Physiological Rev. 48, 65-134. 

[8] Kandel, E., Jessel,T., Schwartz, J. (2000). Prin- 
ciples of Neural Science. McGraw-Hill. 

[9] Marder, E., Thirumalai, V. (2002). Cellular, 
synaptic and network effects of neuromodula- 
tion. Neural Networks 15, 479-493 . 



8 



[10] McCuUoch, W. S. and Pitts, W. H. (1943). A 
logical calculus of the ideas immanent in nervous 
activity. Bulletin of Mathematical Biophysics, 
5:115-133. 

[11] Nichols, J.G., Martin, A.R., Wallace B.G., 
(1992) From Neuron to Brain, Third Edition, 
Sinauer Associates. 

[12] Spiking Neurons in Neuroscience and Technol- 
ogy. 2001 Special Issue, Neural Networks Vol. 
11 



